DOCUMENT RESUME 



ED 217 788 
TITLE 

INSTITUTION 

SPONS AGENCY 

PUB DATE - 

CONTRACT 

NOTE 

EDRS PRICE 
DESCRIPTORS 



HE 015 i84 



IDENTIFIERS 



ABSTRACT 



Quality in the Basic Grant Delivery System: Executive 
Summary. 

Advanced Technology, Inc .,' McLean , Va.pWestat 

Research, Inc.', Rockville, Md. 

Office .of Student Financial Assistance (ED), 

Washington, DC. 

Apr 82 

300-80-0952 

25p.; For related documents, see HE 015 185-187.- 
MF01/PC01 Plus Postage. 

♦Accountability; Change Strategies; College Students.-; 
Confidential Records; Data Collection; Disclosure; 
♦Eligibility;* Error Patterns; Family Financial 
Resources; Family Income; *Federal Aid"; Financial Aid 
Applicants; Financial Needs; Grants; Morfey 
Management; *Need Analysis (Student Financial Aid); 
Parent Financial Contribution f Vostsecondary 
Edugation; Program Administration; Program 
Evaluation; *Quality Control; ^Student Financial 
Aid . 

*Basic Educational Opportunity Grants; pell Grant 
Program 



Findings of a study of -1980-1981 award accuracy of 
the Basic Educational Opportunity Grants (BEOGs), ot Pell Grants, are 
summarised. The study is the first' stage of a three-stage quality 
control project and includes recommended- corrective actions to reduce 
inaccuracies in the grant awards. A ^sample of 4,500 students were* 
selected as representative of the 2.36 million students in the B'EOG 
recipient population as of fall 1980." Data were collected from 
federal tax returns, interviews with";student recipients and their 
parents, tax assessors' statements regarding home values, student' 
records on file in'' college- financial aid offices, and interviews with 
financial aid administrators describing fhe characteristics and 
administrative practices at tlieir institutions. It was found that an • 
estimated $650 million (nearly 30 percent of all program dollars) was 
awarded incorrectly in 1980-1981, more, than 70 percent of all program 
participants received incorrect ' awards, funds overawarded exceeded 
funds underawarded by more than four to one, and an estimated $352 
million was awarded to 450,000 students (19 percent of all 
recipients) who v/ere ineligible under 1980-1981 program requirements. 
The majority of this error was due to information supplied by 
students on the application form. Institutional procedures caused 
somewhat less error, and error by application processors was minimal. 
Recommended corrective actions are of two kinds: those that can be 
instituted within the scope of the current delivery system, and those 
that can be instituted ih the context , of 'a .radical restructuring of 
the system. I,t is suggested that students be 1 required to prove need 
rather than claiming need without presenting verifying information. 
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EXECUTIVE SUMMARY 

i * ' 

- In- September 1980 the U. S. ^Department of Educa- 
tion*^ [ED] Office' of Stijdent Financial Assistance 
, , [OSFA] contracted with Advanced Technology, Ino/, of 

MoLean, Virginia, and its subcontractor, Westat, Inc., 
of Rockville, Maryland, to document the accuracy of 
^ 1980-81 Pell Grant awards , analyze the major tyges of - 

error found, determine . the probable causes of the 
error, and recommend . actions to reduce error. The*, 
^ completed study £inds that an estimated $650 million 
(nearly 30 percent of all program dollars) was awarded 
incpErectly . in 1980-81, mor'e " than- 70. percent' of all 
program participants received incorrecj. awards, 'funds 
ov^rawarded* exceeded fund^ underawarded by more than 4 \ 
- \ .to 1, and an estimated $352 mii\ion # was awarded to 
♦ 4 X , v -450,000 students (d9 "percent of all recipients) w&c? 
m * • were ineligible un^der *1980-£1 program requirements/ 
♦ % ' These ^findings are consistent with, a previous, quality 
' 'control " study (which- found , 2 3 percent' of 'program 
dollars and 59. percent of. awards to be in error) and 
^ . with a recent' da"ta 'match with Internal Revenue Service < 
household income data (which, found -that 2<7 percent of 
' *w ' all* eligible Pell Grant applicants who were tax filers 
- mis-reported Adjusted Gross Income more than $200^. 

-^he study of 1980-81 awa'rd accuracy *is the first major^-. 
* m ' • deliver.abl-e under a. three-stage ED 1 quality control 
/ "... - project. * • • . 

BACKGROUND - „ „ 

— — - < ^ 

• The concern # for* quality cpntrol in the Pell Gr^nt program 
has increased wdth its.- extraordinary growth in both dollar volume 
.' ' (frpm $50 ' million to $2.4 billion)' ^and student participation 
"Revels 1 ( f torn 185,000 to 2.7 million) since its inception in 1973. 
2-ranfcjing sdri 



A- wide-ranging series of quality control efforts were ordered, 
funded, and initiated 'in the years preceding this study. These . 
efforts • included (1> computer edits of application data; {J2) 
selective validation of application £ata by financial aid admin- 
istrators; (3) analysis of 19,78-79 grant award accuracy; (4) 
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program reviews by Central and Regional ED ;sta.ff; (5). audits and 
audit reviews; (6) -data match with other Federal* sources of 
1 information; (7) training of financial aid administrators; and\ 
(8) field testing of application forms. - 

The performance of these efforts^had not been studied com- 
prehensively . These efforts , were ' instituted, independently, - and 
there is little Information that, taken as i c group, they have ' 
significantly reduced error or improved "program management - sub- 
stantially. The primary objectives of this study of- 1980-S1 Pell 
Grant awards are. therefore to: ' " 

m Document* the program-wide Pell Grant error rate 

identify the -principal types and probable causes of 
./srror 

• Assess the effectiveness of validation 

• Recommend corrective actions - to -reduce . major errors 

found in the program 

r - * 

FINDINGS 

'■ — * * 

* Overall 

The findings indicate substantial dollar error in awards to 

students during the 1980-81 acadeJnic year. Dollar error is 

actual award disbursements as -listed in" records at the sampled 

undergraduate institutions in the spring of 1981 minus what 

# 

Advanced Technology qalculated the corrects disbursement to bej 
using the best available information on application data, cost of 
attendance, and enrollment status. . Total dollar error is esti- 
mated to be $275 per recipient, or $650 million of the $2.2 
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billion (30' percent) awarded to : the 2.36 minion recipients 
represented by„ the sample. ■ An estimated 71 percent of the 
recipients received an incorrect award. 

A breakdown of the $650 million is shown in Figure 1 and can 
be viewed from two perspectives: program integrity and bud- 
getary. From the prdgram integrity perspective overawards and 
underawards are of equal importance and need to be corrected 
9 through 'thoughtful action. An estimated 7.1 percent of recipients 
had v^ward: discrepancies in excess' of $2. The magnitude of this 
error is $650 millioft. "An estimated 44 percent of recipients 
represented by the sample had award errors in excess of $150. 
This represents approximately $600 million in program error. 
Figure 2 displays ranges of^error. 

From the budgetary perspective, "net error" (overawards versus* 
underawards) provides a useful estimate of the costs associated 
I with ereor. The "net error" of $402 million is composed of $526 
million in overawards to 50 percent of the recipients (approxi- 
mately 1.2 million students) and $124 million in underawards to 
21 percent of the recipients (approximately one-half million stu- 
dents) . 

Regulations require a financial aid transcript E.FAT] for 
transfer students and a statement (or affidavit) 'of educational 
purpose vs [AEP] for all students in the grant recipient's student 
aid file. Corrective actions designed to eliminate error asso- 
ciated with the lack of an AEP on file have already been initi-* 
ated by ED and should not be- a. problem in futilte ydars. If one 

• * • «» * 

^ ■' '. ' ' J^fTAdvancBd . 
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^Amount of total institutional error plus all student ecror per recipient totaled independently/ 
^Meart for all recipients with error. . ■ 

A1 1 disbursements' to students who are ineligible due fo institutional srror are counted as 'institutional 
J e ff l^ at l° A n l' If SEI error among 'recipients missing affidavits or statements of educational 
student 'erVor ?s $246 Urt 1 l.*S2l* Cr,P ^ fi9Ure ' StUd6nt err ° r tota1s J 352 mi,1ion (net 

4 Undupl icated coiAt of-institution and/or student error. 

5 Mecn> for all students* wit.h averaward (underaward). 



FIGURE I 

ESTIMATED INSTITUTION AND STUDENT ERROR, 1980-81 
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FIGURE 2 
DOLLAR ERROR BY RANGES 
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does not^cdunt a missing AEP or FAT in the student .aid file as an 
error, thfen tot^l "dollar error is reduced to^$527 million for 69 
percent of the recipients. This is composed of $392 million in 
-^verawards to 46 percent of all recipients and $135 million in 
underawards tp 2 3 percent of all recipients. * Figure 3 displays 
program error not iaclydii^ AEP or FAT. 
Student .Efror * 

*The application data element contributing the mjyst toward 
student dollar error was adjusted gross income [ AG I ] . If all Akl 
£ igures submitted on application forms were corrected, net over- 
awards would decrease by $.101 million. The next largest contri- 
butors toward error were incorrect application entries for*' income 
of the dependent student and spouse, home equity ,* household size, 
and assets of fc the .dependent student and spouse. Figure 4 dis- 
plays the impact of the seven items* leading : to the highest 
' appli.cation-related student error. 
. . . ( pn average, study data show that the higher a recipient's 
family AG I, nontaxable income, Assets, or ovm income, '^the greater 
the likelihood and magnitude of estimated application-related 

student error. Further, there is a marked tendency to understate 

✓ f 
income. As a result, the* distribution of awards by income 'range, 

as reported using student application data, significantly over- 
states the number g>f low-income students receiving aid and under- 

states the number of wealthier* students receiving aid. 

J ' * ' 

For example n an estimated 70,000 dependent students reported 

AGIs of tinker $6,000 (23 percent of all dependent .students 
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^Missing affidavits or statements of educational purpose and financial aid transcripts are n<ft 
included as Institutional ferror. Any«cases with error greater- than t*o dollars are Included. 

^Amount of error associated with all types of total Institutional error plus all types of student 
error per recipient totaled independently. 

3 Meaq formal 1 recipients with error. " "* - 

4 UndQpl1cated count of institution and/or student e*Tor.- 

5 Mean for cases with'error. * ' v ^ 



FIGURE 3 <~ 
ESTIMATED "INSTITUTION AND STUDENT ERROR NOT ^INGLUDIN.G AEP/FAT ERROR , 1980-81 
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! For policy purposes, the. data- from our sample are extrapolated to ' v 
progr.am-wide error levels. ' Note-that there is substantial overlap of error 
.amounts, so colutnn total is. larger than actual-total student error. Data 
are rounded to the nearest mil -lion..* 

2 Oata are, rounded to the nearest "dollar. 



FIGURE 4 

IMPACT OF SELECTED INCORRECT APPLICATION , J TEMS 
ON -STUPENT DOLLAR ERROR 
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reporting AGIs of under $6 , 000 ) .when, in fact, the parental AGIs 
were oyer $12,000. Thes^ students were overawarded by over $76 
million.* Overawards are clustered in higher income groups and 
-^nderawards in lower income groups. The effect of obtaining 
cc/rrect financial information could therefore be to decrease the 
funding now going to higher incoiri grpups and increase the fund- 
ing now going to lower income groups. 
Institution Error 

Figure 5 displays* the components of institutional dollar 
error. Excluding AEP and FAT error, the net overaward would drop 
from $181 million (see Figure 1) to $11 million (see Figure 3). 
The $11 milliop would be composed of $111 million in overawards 
to. 2Q percent of all recipients and $100 million in underawards 
to 17 percent of all recipients. 

Apart from missing AEPs and FATs, a small portion of the 
institutional error is due to incorrect program eligibility 
determinations. Most is due to incorrect institutional moni- 
'toring of enrollment status or cost of attendance and to cal— 
* culation error (a variety of bookkeepirig^ and disbursement dis- 
crepancies). These errors work ir^ both directions, and are 
_ a lmo st eg ua 1 ly d i v j d ed among <D.v_erawards .and- underaw^trds^ „How-*~ 
ever, total dollars in error are substantial and deserving of 
further analysis and ^corrective actions. 

The findings indicate a wide diversity in satisfactory aca- 
demic progress policies and inconsistency among institutions in 
the application of these policies- to financial aid recipients 

V - v . - JE^s^S — 
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Component figures are computed independently for each type of error. 
The sum therefore exceeds the total, of all error, because error has been 
counted more than once in all cases where more than one Jtype of error 
occurs. • 

Estimated breakdown of institutional error components using .spring 1981 
data* Final component figures will be derived from institutional 
reconciliation rasters as part of Stage Two of this project. 



1 FjEGURE 5 

SUMMARY OF INSTITUTIONAL DOLLAR .ERROR INCIDENCE* 
AND ABSOLUTE VALUE 
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(e,g., separate policies are sometimes applied .to students from 
disadvantaged backgrounds, and probation periods were extended in 
individual, cases,). in many cases, institutional satisfactory 
progress policies do not take into 'account withdrawals from 
•cdurses and do not have any requirement that students make normal 
progress toward an educational .degree or certificate. These 

i 

findings corroborate a recent GAO report on satisfactory academic 
progress*. 

The issue of satisfactory academic progress is being 
addressed by new ED rules, to be proposed, that encourage insti- 
tutional • self-regulation and responsibility. 
Current Validation Efforts 

One method used by OSFA to improve the accuracy of. applica- 
tion data is validation — a process "in which a sample of appli- 
cants are selected and certain data items are verified by finan- 
cial aid office personnel. Unlike this study which verified all 
application data, ED-manda ted * validation requires only certain 
d^a items to be checked. Thus, this study will necessarily 
reveal discrepancies not uncovered during validation. An esti- 
mated $146 in absolute award discrepancy due to student error per 
validated recipient remained after validation. 

For 12.8 percent of recipients in the sample who were 
flagged for validation, documentation of incomrf was not found in 
the student financial aid file. Where income documentation was 
found in cases flagged for validation, income information was not 
within accepted tolerance in 11 percent of the cases. > This 



^suggests further improvements in the validation process ,,are 
necessary. The average absolute award discrepancy due to. student 
error was $1^2 for recipients randomly flagged for^ validation. 
By contrast, the\absolute award discrepancy due to student i^rror 
was $135 for recipients not flagged for validation. This $23 
average improvement is one measure of the effect of validation on 
student error. 

Processor Error / 
An analysis of the error rates associated with data entry by 

Multiple Data Entry [MDE] application processors revealed little 

error. The results indicated an estimated 1' data entry error for 

every 37 applications (2.7 pet-cent) . * * 

An estimated 78 percent of all data entry errors were never 

corrected by the applicants. In fact, of all data entry errors 

that were to the disadvantage of th>e applicants 60 percent were 

never corrected by the applicants. 

CORRECTIVE ACTIONS 

One objective of the Pell Grant program is to treat students 
of equal financial circumstances equally. The magnitude and fre- 
quency^of incorrect awards in^ica.te that this objective ,is not 
being achieved. In response to the problems just described, 



Advanced Technology proposed corrective actions to reduce error, 
increaae equity, and assure integrity in the program. An assump- 
tion was made, based. on the study findings, that error was pri- 
marily caused by the complexity of application information and 
award determination procedures and by frhe self-reporting nature 
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of the program. As a result the recommendations for corrective 
action focused on simplification of procedures and verification 
of data, 

Advanced Technology proposed two kinds of corrective 
actions. Many of the recommendations included are now being 
considered for implementation,^ however, the listing of these 
recommendations does not imply concurrence by ED. Final deci- 
sions on acceptance or rejection of th<| recommendations have not 
been* made by ED. The first kind of corrective actions is 
mechanical actions to make changes within the scope of the cur % 
rent -delivery system for Pell Grants. . The second Consists of 
. major structural chfnges in the" way Pell Grants are distributed 
to students. Whereas the mechanical approach aims to control on 
a continuing basis the error levels within the current delivery ' 
system, the structural approach aims to eliminate certain persis- 

0 

tent errors by more radical' means. Structural changes are neces- 
sary given the assumption that corrections to the existing deliv- 
ery system will not bring the error down to a. satisfactory level. 

In presenting the mechanical recommendations, a distinction 
is ma'de among corrective actions involving the 1 student, the 
institution, and the application processor. For each of these 

errtdrt±es7~T^^ 

the problem^ and establishing broad themes for solutions. To a 
degree, 'the recommendations represent choices. The -adoption of a 
particular strategy for error control may alleviate the need for 
certain of these recommendations. 

V t ; j£Ti A 4™? a *' 
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Mechan ical Actions - Student Error 
! ■ — t 

Student error may be alddx^essed by three central themes: 

i 

- • Asking the applicant to prove peed, 

• Improving the identification *and validation of likely 
erroneous applications * " 



y 



Making the application form itself less error prone 
In turn, a set of a 



even action recommendations to address 



these themes was proposedi 



Issu« a valid Student. Eligibility Report [SER] only 
when^ an IRS 1040 or a certification of public assis- 
tance accompanies the application or alternatively 
only when a signed release for IRS data -match accom- 
panies "the application. * \ 



• Continue ED-mandated validation but use the selection 
criteria developed in Stage One. 

• Publicize to students the validation activity and its 
possible consequences . 

• Establish one individual at eaah regional office to be 
responsible for following up on each institutional 
referral from that region. 

• Change the definition of dependency status -to exclude 
current year estimates. 

• Obtain the names of household members who ,will be 
enrolled in post secondary edupation institutions 
during the award year. t 

• Improve the 'definition of various items on the applica- 
tion form. 

Mechanical Actions - Institution grror 



.Problems in the institutional component are also addressed 

by three centkal themes: 

* 

• Creating an incentive in the program for students -\o 
'complete course work~ • • « • * •? 

• X Changing administrative procedures to promote ."program 
Compliance arid reduce d§lay N 
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• Adding new verification requirements for critical 
application items ' * 

To address these problems more concretely, the following 
six corrective actions'were proposed: ^ 

• Introduce a program-wide minimum credit requirement in 
place of satisfactory progress policies designed by 
institutions . v 

Restructure the payment schedule to broaden cost* of 
attendance and dollar award categories. 

• Have institutions complete a mid-ye'ar student yalida- 
# tion roster in addition to the one required at the .end 

of the award ^ year for reconciliation of disbursements. 

• Allow financial aid officers [FAOs] to recalculate 
Student Eligibility Indexes [<5EIs] based on corrected 
data^ and make first disbursements to students while 
waiting for receipt of the corrected SERs from the 
processors. 

• Specify a new edit for the processor edit system that 
will trigger a validation flag 1 if student s / show 
dependency status , change between years. . \* 

• . Require- that*eligibl-e recipients, until the time of: the 

first disbursement, correct SER data . regarding house- 
hold size*>and the number ^n College to reflect their' 
, actual situations. 

Mechanical Actions - Processor Error 

Finally, problems fit into three ma jor corrective actions 
• * ** 

themes for processors: 

• Rationalizing internal processing procedures 

•v. 

• Improving management decision-making tools 




• Improving the' efficiency "of communications with stu- 
dents 

Advanced Technology proposed 13 recommendations to, meet 
these potential problem areas. These are generally of a techni- 
cal nature and do not alter the application procedure to a large 
degree. 

r Advanced 
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Structural Changes 

Based on the hypothesis that there is *a certain level of 
error endemic to the current delivery system (i.e., error that 
Cannot be 1 controlled by mechanical corrective actions) f Advanced 
Technology explored ^ the decision procedures necessary before 
developing a structural redesign of the Federal student aid^ 
delivery system. It is imperative tc* undertake a systematic 
exploration of policy preferences, constraints, and assumptions, 
prior to full-scale development of alternative delivery methods. 
However, it i£ instructive- to highlight the shapes* that a new 
delivery system might take. 

As a part of this stage of the project, preliminary ideas 
for changes in the application, institutional, and processor com- 
ponents of the student aid delivery system were outlined. 

The major/ trade-off in the redesign of the application pro- 
cess is between a streamlined, simple ..application form with only . 
a handful of easily verifiable data items and -an application with 
sufficient family financial data to permit discrimination of * 
^weatth" among applicants and to take into account special or 
urfe^ual financial situations. Implicit in Jfcfre decision process 
is the question, of whether discrimipation of "wealth" is be,st 
done at the Federal l«tvel through a complex formula or at the 



institutional level through indiyidual attention. 1 T]hree alter- 

natives were considered?: t 

• The "micro" ^application procedure consisting of very 
f^w verifiable data . elements for , any or all of « the 
* student* aid programs * • 
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• The short form/lotig form application procedure which 
allows applicants to file a "micro" form or a stan- 
dard needs .analysis form if the latter would better 

„ reflect » their financial situations- 

C • The dual needs analysis procedure whicli. mandates the 

"micro" form for Pell Grants but allpws campus aid 
offices the option of using a standard needs analysis 
. form for crther types of Federal financial .assistance 

For institutional procedures^* the redesign and use of the 
current . payment doaument, the Student Eligibility Report [SER], 
\yere considered. b^tiong described included the use of an opti- 
cal scanner payment card that WQuld be used by a central comp- 
troller to monitor* disbursements and expenditures closely, 
release and control funds to institutions, and -maintain checks on 
student enrollment status and- cost of attendance. ' 

Finally, in the arSci of, application processor redesiqn, the 
following three procedures were explored: 

• Total integration of Federal student aid processing 

• Remote entry capability of Federal "student aid proces- 
i sing . 

. • Combined Federal transfer payment application proces- 
sing 



METHODOLOGY 



The methodology used to. accomplish "tfie Stage One objectives 
is ^briefly' described. For .more information see Quality in the 
_ ,Basicj_ Grant DeLifr ery_Sy s tem,^ Vol ume._3. , Methodo logy ,.. *" [_ 



Sample Design " , 

The prikary objective of the sample design was the selection 
of a probability sample of students* enrolled at educational 
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institutio^* inv<5L/e<?-' IV the '1980-81 Pell Grant program. To 
accomplish th4^^^^^^i^ut jons and students were selected in ' two 



stages: (1) ^str&ti ti^g^on and random selection of 305 iristitu- 
tions and (2) stta^*3^'<?j|*.ion and random selection of approx-i- 
mately 4,500 Pell Gyatftvjfecf pi«rit£ ;f rom these institutions.- Over 



'90 percent of all ^tu^ent^ and parents in^ the sample responded 

with an interview, '^fiee total population represented by our sam- 

t ■ * > * 

pie (students who received awards b# October 1980) is approxi- 
mately 2.36 million Pell Grant recipients. This comprises 
roughly ^3 percent of all Pell Grant recipients for 1980-81 and 
represents over $*2.2 billion in awards. Both the institution and 
student sample sizes were larg£ enough to ensure the required 
statistical precision. ^"^^ 
Data Set 

♦ * * ■ 

The 'data came from: * 

• 4,304 interviews with student recipients* 

• 3,829 interviews with recipients' parents 

• 5,161 certified Internal Revenue Service copies ofc tax 
returns for recipients and for their parents 

• 270 financial institutions, giving bank account 
information for a subset of recipients and parents 

• 569 statements 1 of t^e^ipients' or parents' home values 
provided* by 'tax assessors (adjusted to local market 
values) 



~ * 47S53~ Sraa^mrrriteuora Ab s tr prct^ri"Sl lAs] draw n — from t he ~ 
financial aid. and accounting files of the 305 c institu- 
tions the recipients* attend ' 

• Interviews with financial aid administrators .describ- 
* ing characteristics and administrative practices of 

'the 305 institutions ' - N • ' 



In addition, data were analyzed from the computerized files 
of Pell Grant transactions and corrections' for each recipient in 
the sample and for a* control ' group of Pell Grant recipients 
selected to measure possible experimental effects of our project 
on students and institutions. 
Limitations and Considerations 

Calculations of error are based on a set of definitions 
which take the year-long Pell Grant program cycle into consider a- ' 
tion. The ' data ' upon which students were paid were verified 
against the most stringent documentation collected through inter- 
views, record searqh, IRS 1040 match, and inquiries to financial 
institutions and county tax assessors offices. The total award ' 
error used in tnis report is the difference -between actual and 
planned disbursements recorded .on institutional, business office 
files in the spring and- expected disbursements calculated using 
the best SEI and the "cost and enrollment data found in the 
.spring. The universe fro^n whi-ch , the sample was taken 'excludes 
consideration of four groups: 

• , Applicants for Pell Grants who .were rejected by the 

application processing system and never "reentered" "the 
system 

• Applicants who were determined to be v eligible but were 
never given awards 

, • Applicants who applied later^in the award year (after 
October 1980) 



Applicants who filed a Special Condition Application 
(Supplemental Form) 
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The data .from institutions were collected* in April and May 

of 1981 . Between^ this period and the period when institutions 

/ • 

submit their final reconciliation rosters to ED, institutions 
might have corrected certain institutional errors. This reporla 
does not reflect* this • self-correction. A follow-up analysis iJ 
being conducted now to determine the' ' impact of institutional 
self -corrections on the error rate. 

Finally, several taqtors contribute to make ' the error fig- 
ures somewhat conservative (that is, error was understated) . 
These include: 

• The sample represents approximately 83 percent oft all 
recipients and excludes recipients who filed later in 
the awa^rd year and recipients who filed a supplemental 
form. if error among late filers and supplemental 
filers was similar to error among recipients repre- 
sented by the sample, the estimates of dollar error are 
17 percent lower than* true error for 'the program for 
1980-81, 

* 

• The stpdy was not designed to study fraud or 'inten- 
tional misreporting of data by 6 applicants. For 
example, if an applicant failed to disclose a source of 
nontaxable income on the application and further failed 
to disclose this .source to the study data col- 
lectors, no error would be uncovered. , 

• Evidence from a review of transaction history file data 
suggests that the^behavior of students and/or institu- 
tions .was affected by our data collection. Sampled 
students submitted corrected SERs more often than non- 
sampled students at the same institutions, had fewer 

> additional corrections, and had higher SEIs than stu- 
dents in a control group. This evidence points toward 
experimental bias in the direction of underestimating 
program error. 



In the first stage of this quality control project, Advanced 

X 

Technology has documented the discrepancy rates and magnitudes of 
error -in the Pell Grant program for 1980-81. They 
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have also examined the causfes pf the errors and recommended 
management- actions to reduce them. In subsequent stages, 
Advanced Technqlogy will- design and implement an ongoing quality 
control system 'to regularly monitor the integrity of the Pell 
% Grant program. Th<ey will also provide/assistance with regard to 
corrective actio^ proposals being ^^sidered by ED and conduct 
analyses of issues raised as a consequence 6f the first-stage 
4 findings T~ » 
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